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Results of a self -assessment of the doctoral program 
in higher education at .the University of Georgia are presented. The 
X>raduate Program Sell'-Assessment Service questionnaires were 
administered to 43 gradi^ate», 12 currently-enrolled graduate 
stisdents, and 14 faculty members. Areas of assessment for tlie 
graduates included: average numbej^ of years since graduation, type of 
em^)loyn^nt. productivity, and reasons for earning the doctorajte.- For 
currently-enrolled students, concerns were: ethnic background, 
current jobs, preferred job activity, financial aid„ grade point 
average, and numbfir of years since receiving the und«^rgraduate 
degree. Areas oT concern for faculty included academic rank, full- 
versus part-time employment, highest degree held, time spent in 
instructional and noniastructional ti^s, and time since receiving 
the doctoral degree. Faculty, student, and alumni ratings were also 
obtained on: the learning environment, scholarly excellence, quality 
of teaching, faculty concern f or stiftents, the curriculum, 
departmental procedures, available resources, student 
commitmertt/motivation, i^udent satisfaction, student assistantships , 
departmental performance, faculty work environment, dissertation 
ex)>eriences, and faculty research and professional activities. 
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The doctoral program In higher education at the University of Georgia 
was developed In t^\pon5e to requests from the College of Education and 
other academic unts on the UGA campus. Instruction at the doctoral level 
was not an original charge to the Institute of Higher Education and v/auiot 
envisioned as a responsibility In 1964 when the Institute was Initiated. The . 
/ Institute was, however, the most logical and the best staffed uiAt within 
which to develop a doctoral program In higher education. Program planning 
and course development began In 1%8, In cooperation with Dr. Daniel |. 
Sorrelts who w. then In the College of Education, and the first students were 
admitted In 1%9. Two years later, three of those students became the first 
graduates of the doctorsil program. 

When the first degrees were awarded, an administrative decision placfd 
the institute of Higher Education within 'the College of Education for pur- 
poses of the graduate program. Explicitly stated at that time and frequently 
reinforced since was the expectation that the Institute would remain a service 
and research agency of the Onlverslty of Georgia. The institute thus acquired 
dual responsibilities as a department^f Instruction within the Cotle^ of 
Education and as a public service agency of the University of Georgia. No 
funds have been allocated for a department of higher education, but admin* 
i^trath/e/budgetary relations have been^|»9tkcooperatKe and efficient. 

The doctoral program thus began umier ambiguous circumstances, and 
it has continued to operate under arrapfS»ment$ different from the traditional 
unlversity/coilege/department hierarchy. The Institute of Higher Education 
Is a unique administrative or budgetary unit of the University of Georgia. It 
te the only unit on the UGA campus with explicit service, research, and 
Instructional functions; other units have combinations of these functions but 
the institute Is the only unit combining all three. The doctoral program in 
higher education Is also unique In that no coursework Is offered at either the 
^ master's or the undergraduate level. The doctoraf pro-am has been dcvel* 
oped within the framework of the University of Georgia's commitment to 
public service, and a substantial portion of the program's success must be 
attributed to the different learning environment an Institute or center can 
provide. The doctoral program In higher education has received national 
attention for the opportunities given graduate students In the Institute's 
service functions and activities (Dres&el and Mayhcw, 1974). 

PROGRAM OBJECTIVES 
% The doctoral program In higher education was initially conceived as 

/ . an interdlKlplinary program of study that would appeal strongly to stu- 
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dents with backgrounds in the behavioral and social sciefSces. More spe- 
cifically, it was Intended that students maintain disciplinary cor\tact with the 
fields they studied at the nriaster's level. It was expected that students with 
masters In the behavioral and socir!* sciences would enter the doctoral program 
ar»d would seek to maintain ties with those disciplines by taking at 4easi 20 
hours in this major field at the master's level. 

Neither staff selection nor student inieresis remained compatible with 
the original intents. The Institute's service commitments called for experience 
and expertise in academic adminlstrztion. student serviceili, and program 
development; the learning needs and interests of applicants reflected back- 
jfrounds in educational speclaJties Instead, of ^ behavioral and social sciences. 
/Degree renulrements Have continued throughout, however, to specify 20 
hours outside the College of Education. Analysis of doctoral coursework 
shows that sociology, political science, and management have been the most 
popular fields of study ouuide the College of Edqcation (HolbrdfJk & Galvin, 
1981). 



PROGRAM ASSESSMENT \ 

A comprehensive rc-asscssmcnt of the doctoral ' program In higher 
education has been recommended by the Committee on Gr"^,duate ( jurscs 
and Graduate ' Programs. This r«;ommendation stems from the report of 
a graduate school review committee appointed to review the doctoral promsidn 
i in higlicr education three years ago. In recommending the contlnuanct;# the 
doctoral program In WIgher education, the reylew committee txpxf0i reser- 
vation about the placement of a graduate progwim within a seryW institute. 
Members of the review committee also questioned the location of the Insti- 
tute of Higher Education at some dlstance^from the College i(if Education and 
had obvious difficulties in understanding the functions ^ activities of the 
Institute as they related to the doctoral program. Al^ough thecrlttelsms of 
the fevlcw committee were answered by the Institute staff In a followH<p 
report, the Institute staff's report was not made available to the Committee 
on Graduate Courses and Graduate Programs, i^s the result, the Committee 
on Graduate Courses and Graduate Programi responded to the review com- 
mittee's criticisms concerning program -o*>iectlves, their rtlatlonship with 
program structure and content, and the advisability of a doctoral program 
within a service agency of the University. These are the criticisms that the 
self-assessment report primarily addresses. 

ETS SELF -ASSESSMENT SERVICE 

The Graduate Program Self-Assessment Service provided by Edu- 
cational Testing Service (ETS) uses confidential questionnaires which arc 



complcled by teaching faculty, curremlVi enrolled students, and recent grad- 
uates. The questionnaires have been developed in cooperation with commit- 
tees of graduate deans and faculty members and are designed to obtain infor- 
mation about "quality related program characteristics in seven areas": pro- 
gram purposes, faculty training and accomplishments, student ability and per« 
formance, resources, academic arid social environments of the program, 
program processes and procedures, and alumni achievements. . 

Each questionnaire contains about 60 statements concerning program 
characteristics with an agree-disagree or poor-to-excellent format for Ve- 
sponsic. Many sutements appear on all thre' questionnaires, thus allowing 
comparisons of faculty, student, and alumni opinions. When completed, 
the quMtionnalres are relumed In scaled envelopes, with a brief program 
description, to ETS for analysis. No names are requested on ihe question- 
naires and all data are reported in summary form only by ETS. The self- 
assessment service is supervised by the Graduate Records Examination Board 
and is sponsored by the Council tff Graduate Schools in the United Slates. 
The questionnaires themselves are well-designed, easily completed, and par- 
ticularly relevant to the purposes and functions of graduate programs. 

* ' 

ASSESSMENT PROCEDURES 

In the fall of 1982, a total of, 25 graduate students were engaged in the 
doctoral program at some stage of academic progression. Forty»six graduates 
had completed the program and were employed in various capacities. In 
addition to students and alumni, 14 faculty members were identified as having 
served on the advisory and examining committees of doctoral students in 
higher educationr Some faculty members closely involved in the program, 
however, could not be contacted. Dr. Danfel |, Sorrells, Professor Emeritus 
of Higher Education, was on tbe west coast and could not complete a ques- 
tionnaire even though he had been actively Involved in the program from its 
beginning and had served on virtually all^the advisory and examining com- 
mittees of the 46 graduates. 

All questionnaires were distributed with a covering memorandum from 
the Director of the institute of Hlgt^er Education, stating the purposes of the ^ 
questionnaire and requesting cooperation in its completion. Forty-three of 
the 46 graduates returned their questionnaires in time for inclusion in the 
study. Another qjuestionnaire w4s returnedi on the day following tr3iismission 
of the questionnaires to ETS. Of the currently enrolled graduate students, 21 
returned their questionnaires tor inclusion In the study* The response rate 
of 84% would have been higher had the location and status of four students 
been more readily determined. Of' the 14 faculty memberj completing • 
questionnaires, five are professional itaff members in the Institute of Higher 
Education while the other nine are University of Georgia faculty members in 
other departments of instruction. This fact simuld be noted because the 



majur.iiv of the fespondinj; faculty members consists of faculty members iu 
other departments who teach doctoral student* in higher education must of 
the 20 hours outside education they arc required to take. 

ASSESSMENT RESULTS AND FINDINGS 

» 

The most relevant findings of the ass«5mem pertain to the 43 grad- 
uates who supplied background Jnforrhatioh on their subsequent careers. 
For this group, the a^^efage number of, years since graduation was four* The ^ 
average nuniber of years spent acquiring the degree was three. It Is Inter* 
estingj however, that the average number of years from undergraduate degree 
to completion of the doctoral degree was 14, a fact reflecting the admission 
requirement of a master's degree and work experience in a collegiate setting 
prior to entering the program. The academic achievement of the graduates 
is reflected in a 3.02 average undergraduate grade«po|rft*average and a 3.81 , 
average grade^oir^-average at the graduate level. 

PLACE OF EMPLOYMENT; A plurality (37%) of the graduates arc cm- 
ployed in PhO-granting universities; 23% are employed in four-year colleges 
while 21% are employed In community or two-year colleges. Two of the 
graduates have returned to secondary education^ one of them being the Head 
Master of a large preparatory school In Oklahoma, Two others are self- 
employed or in private practice, while three students Identify their place 
of employment as a non^proflt age'ncy and one graduate indicates that he is 
employed in government. No gradtiate ts employed In business or industry, 
although one graduate just recently returned to a college campus after serving 
a^ a management re€;iiiter/developer for a large industrial concef n. 

PRIMARY DUTIES: In describing thcV work, 74% of the graduates state 
tht;' they are engaged in admlnistr^tioVi or management. Mine percent desifc- 
nate their primary activity as teaching, while seven percent have a combi^ 
nation of research and teaching duties, aiM at least one person is engaged in 
research only. One graduate identifies his/her primary activity as the pro- 
vision of professional services. All responding graduates are empluy^d full- 
tim&and report an aver^ income of $31,178. Only three grad iates report 
an annual incdme under '$20^CK)0» and two graduates report an annual income 
over $SO,OOG. When asked about their current use of the doctctral training 
they received. 79% of the graduates responded that they use their doctoral 
training "quite a bit'' or '*a great deal/' Only one graduate reported that 
he did not use his doctoral training in his current employment duties^. 

When asked if they were under-employed, 65% of the graduates res 
ponded "No*' and 28% responded ''somewhat/' Three graduates believe they 
Ire definitely un Jer-employed at the presort time, a condition that is dictated 



in M least two cd!scs by ihc fmpluymcnt oppdrfuniiies available if) sptnms. 
When asked about the help they received in findinfj a \ub, the Kraduaies did 
not attribute a great'dea! of help to the Institute s formal or informal effurtv, 
the University's Placement Office, or opcninj^s listed with professional assf>^^ 
ciations. Apparently the one significant source of assistance for the graduates 
was the effort of individual professors, Thirty-threc percent of the graduates 
thus replied that they had found the assistance of individual profess<irs 
"extremely helpful/* 

yROOUCJIVITY: The productivity of the graduates is indicated by the 
appreciable number of publications since the completion of their degree. The 
aVerage number fot the group is 13, with an average number of seven books 
on monograpF^^ublished and an average number of five articles or reviews, 
Tv*enty-t*Tlfe^efcerit of the graduates stated they k^ve not published at all. 
a condition that reflects, no doubly their respective job duties and responsi- 
bilities. No graduate has received a post-doctoral fellowship and 72% of the 
grou^ have done no further research in the area of their dissertation. Five of 
the graduates have published articles basmi on their dissertation. In the past 
two years, the group has made an average number of seven preseniilions at 
professional meetings and ont* graduate ha» servid as a vrsJtIng professor. 
The average age of the graduates is now forty-two years. The group is pre- 
dominantly male (72%) but the number of women graduates has increased 
ir? reccpt years, 

■ . / 

RE ASONS.FOR EARNING DOCTORATt : Irt rcsponw to ^ questiofi ^boul 
their primafy purpose In punwiing rhc doctwal degree, 81% indicated that 
their purpose was preparatfon for profe&slonaJ practice. One graduate indi- 
cated that he had prepared fof.rcsearch and teaching, while three graduates 
indicated personal enrichn^nt, and four indivlduaU indicated "prher:'' When 
asked how well .their doctoral program prepared them for the pr«n*4*'v purpose 
they had indicated earlier, 10% of the graduates responded "es^tiemrfv well." 
An additional 28% responded "fairly well"; only one individual' 4ijdlcaJed 
that the (Ipctorai program had not prepared him well for his cwrrtni duties 
ii 1 responsibilities. 

OURRENTLY tNROLLEO STUDENTS 

Students who are presently irtvolved in the doctoral program in higher 
education display slightly different characteristics from the graduateA. Al- 
though 76% of the current students are male, ^he group includes one Amcr- 
ita*i Indian, two Oriental or Asian students, and one Latin Amci|cah student, 
Jhrce of the students currently enrolled thus are foreign students. None of 
the currently enrolled students are black; one of the graduates is. The average 
age of the group Is 36 yiars. 
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A majority (52%) of currcntJv efUoUeti siudcntii arc pur^uinR their 
ileRfees while empJoycd ai;d indicate that they w!d femain fn ihiMt lurrcn? 
positions upon completion uf the dega^e. fhri-e students e^f>ect to return 
to ihcir previous employer but to a new posilion. Only five of the students 
indicate that they do not expect to tttui^y l« their previoir^ employer. A 
majority of the studenis (54%) Indicate that they would like a po^i-dnctoraf 
fellowship upon comptetjon of the degree. Their preferred job acuviiy, 
however, is admi-'istratlon or management (76%), teaching (10%) and a 
combination of rcseajrch and teaching (10%). Forty-three percent of the 
studenis would like to work in a PhO-granting university, while 38% expressed 
a prefefence for four-year colleges and 19% ejcpressed a prderence for com- 
munity colleges. Th^ are the only preferences expressed by the currently 
enrohed students- None of them expect to go into bu!iiness, or industry* or 
government, or to work in a non-pujfit agency. 

Sixty-two percent of the currently enrolled studerus receive no finan 
ciai aid while pursuing their doctoral studies. The average grade-point-average 
for the group is 377. a figure that may be compa/ed with a 3 JO they earned 
at the undergraduate level. Forty-eight percent of the group slate that they 
are enrolled full4ime, .v/hile 38% 5ndk te that they are enrolled part-time. 
This leaves 14% who were not enrolled al the time they completed the ques- 
tionnaire. 

For the group/thc average number of years between undergraduate 
degree and enrollment In the doctoral program is nine years. The average 
number of years of enrollment in the program itself is three years and the 
expected number of years remaining for completion of degree requirements 
is two years, Two of the currently enroUed students have published four or 
more articles in profewionanournals. 

TEACHING FACULTY 

Faculty members serving on the advisi>ry and the examining commit- 
tees of students in the doctoral program are, as would he expected, pre- 
dominantly full professors (57%). Two of the professors, however, hold 
rank at the associate level, while another iw^ hold rank as assistant pro- 
fessors. With the exception ftf one part-time position, these faculty members 
are employed full-time. Sixty-four percent of the group hold t^e PhD, while 
36% hold another doctoral degree. A majority of the ffoup (79%) are tenured 
at the University of Georgia, 

The average number of years since receiving their own doctoral dexrec 
is IH^ years and the average number of years of teaching experiehce in a uni- 
vt rsity is 17 years, As a group, these faculty members spend 46% of ihat 
time teaching and advisit^g students, 25% of iheir time in research or schulat 
ship, and 29% of their time in administration or other duties. The average 
age of the group is 50 years. 



In ihe pnt two yr^r%^ facudy members in thiv group hjive made an 
ivcrage number of cighl pre^utiom at regional of ti4ifunal pfofe^ionai 
meetings. As a group, they sp^d iin average number of 1? dav'i away from 
the campu!k in profei^ionai activlities such as presencai ions and consuliaiionv 
Their schofariy producrivHy h reflected In an average of 40 journal articles 
and/or reviews, an averiRC of ten books or monographs, and an average total 
of al least 50 publications. In the ia&t ihrce years, the teaching faculty in this 
group have published an average of eight profession^ ankles or book chap- 
ters, two Kholarly book reviews, one book, one edited book, and two mono 
graphs. Three of the faculty members have published nver 75 ankles, reviews 
or monographs during their careers and indicate from l(j to 25 articles and 
reviews in the past three years, 

ANALYSIS AND INTERPRETATION OF RESULTS 

As a means of analysing and interpreting the detailed questionnaire 
data. ETS has developed scales for selected clusters of quest ionrtaire items 
Sixteen scales have been developed and the mean scale score for faculty, 
students, and aiumnt on each of these scales is reported in Table 1 . As sh«wn 
in the labte^ each scale h a fouri)oint scale with the direction of the scale 
being dependent on the response format. This means simply that some scales 
have been inverted vo as to present preferred or favorable responses as **high ' 
scale scores. 

The dlstifKtive feature of the reported s^ale scores is the consistency of 
opinion reflected by faculty members, students, and graduates of tht doc tf>ra{ 
program. With a single exception^ the average Kale score reported for the 
tbree groups exceeds 3.1 on a fourn^oint scale. That single exception is the 
rated satisfaction of currently enrolled students with their assistann^ips, a 
finding based on the. responsesv of only four students and excluding the 
opinions of maiiy gradu^^es who served as student assistants. 

The mr n ratings reported in Table I are, of course, subject to inter- 
pretation. Cue rule of thumb that might be applied h to look at the mean 
Vat'ngs In relation to their standard deviations, if the respective standard 
deviation is relatively small (i.e. less than .SO), the mean rating shouted reflect 
signlfk^nt agreement on that particular Kaie. If the standard deviation is 
relatively large {i.e, greater than .50), this could suggest a variance of opinion 
that should be examined carefully. For example, the mean rating of graduates 
or alumni on the "Faculty Concern for Students'' scale Is 3.36 but the ^ut)* 
dard deviation h .63, One of the larger indices of variation found for the 16 
scales. For ratings on a four-point scale, this variance of opinion implies that 
some respondents have expressed "unfavorable** or "dissatisfied" opinions 
concerning facuhy attitudes toward students. Another way of stating this 
implication is that not ail graduates of the program have enjoyed a thor- 
oughly satisfying relationship with all members of thft faculty - an obser* 
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FACULTY. SlUOtM. ANUGRAUUATt RATINGS ON St LP ASSISSMINT SC AILS 



Scale Dcstripiioni 



l>fOUp 



Sl> 



* 






- .. ^ 1. .. 


tnvirunmcni for Learning 






1 




faiulty 


3. 3 7 


.47 


Mufuaf respect ard concern 








beiwctn students and faculty; 


iiuucnts 


i,io 




heipfuiness of othet shjdenis', 








openness to new ideas and 


Alumm 


331 


AH 


points3f vie* . 

« 




* 




Schobrty Excttlence, g 










FacuUv 


3.20 


.61 


Accompllshmenss of faculty ; 








ability of students; and 


Students 


3 Jo 


.46 


mtelleciual stimulation in 








the prognim. 


Aiumm 


3.27 


,62 


Ouaiity of Teachins 










Faculty 






Faculty recepttvity to new 








ideas; their helpfulness to 


Students 


3.30 


.45 


students in course work ^grading 








standards; Dreoairation for 


Aiumnt 


3.19 


.56 


class. 








Faculty CorKem for Students: 








Faculty 


3.43 


.S2 


Interest in professional 








developm«^ii of students, awareness 


Students 


3.27 


.55 


of student /needs and interests; 








availability to students; 


Aiumni 


3.36 


.63 


openness to suggestions. 








Curriculum: 










Faculty 


3.42 


.56 


Variety and depth of coursework . 








program flexibility, opportunities 


Students 


3.18 


.60 


for individuai projects; relations 








with other departments. 


Aluenni 


3 25 


SO 


Departmental Procedures 










faculty 


3.36 


.4'i 


Relevance of policies and actions. 








advHement and evaluation of 


Students 


3 2i 


53 


sfudents, administration of 








degree requirements^ 


Alumn< 


3 32 


55 
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K4tu(i>> on Self A^st-v^ji^eni S<<ik'H (con{if»ut"J) 



« 

Adi^quiKv of finaniiijl and 
phyMcal fe5cu/ccs, quiiiity^ 

lthr«ery and coriput<*f center , 

h Student CommUn^nt/MotiViitHJin 

i miiusiasiic mvolvemen! with 
field of ^ludy ; willinjirtrvvta 
drj unaisigned fwdrn^, cffuVu 
!o prepare for clasK'J ^nd 
lu persist in program 

^' Student SaiisfKition 

judgments of stadenfs ahnui 
wf^at ^h^'y have tcarr^cd, Their 
prepiraiion fo/ career, and 
wiHingness it> rKommend 
pr^^grams to others " 

\0. Sfudent Assii!^tanlsh«ps 

t tmiribution of experienci^ 
av assistant to academic 
ani uofessio iai development 



1 1. UepaftmtfTiial Perfofmance 

f aculty lud^menr^ about 
leaching, depaitmental 
managemcni and planning, 
and dt'etlion or guidarKe 
given 

12 faiutty Work tnvironmen? 

Satisfactmn with ohjctiivrs 
and procedures, academic 
freedom, opportunities 
to participate tn decisions, 
and retatiof^s wi»h others. 



f jtuity > 28 

-Students . If 1» 

Atumoi I iZ 

f >cuU> 5 2t 

Students } 59 

Aiumnt 

f aiiuiiy 
^ Students 3 S2 

Atumnt i S9 

f acuity 
* Students 2 7S 

Atuntm 

facu!iy 3 15 

Students 

Atumni 

J acuitv i 5K 

Sfii dents 
Alumn* , 
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1 i OiviML'rUtiun txper ii*ntf> 

tupicv and rcquirrmi^iiU, 

iippficd, and rdevancc lo 
protcs&tunat dcvdopmeni 

14. Value tor tmploymcni 

KdcvMncc of education for 

about aiurM?vi»ofk, fatuUy, 
and academic standards. 

IS } aculsy HcM^arth 

KciOgniKon^ivenfaculiv tn 
research, schotarly writmg, 
service as ediiofv and 
retefeei», and obummg 
le^earch funds. 



i acuUv 
btudents 

( atuiiy 

iiiudenis 

Aiumm 

{ acuiu 



1 >> 



in 



46% 



44 



44 



3S 



U» FfofessJOful Activitufs 

Ncfviic oi UtulKy on natianat 
iommiifee^ ox panels, in 
rei^ional or nalionai avrfKMHuns, 
^td ciihcf kinds of professional 
visabdtty 



b7% 



NOU Numbtf of respondent will vary by urn c 1 1 tacufiy rcsf>onses untead of )4] ur 
more because alt respondcnis did ml answer ail quesuons, 

Scak* 10 $iuiws faimjcs uf ont ? four siudenis presenily vrvmv; as x^adiufe assislanis 

VShere no mean rjtiOKv -*fe stiown for a Rfuup, that S4.a!e was nui part ul Uu- MUtMion 
riaue compk-ied by thai group 
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ffCMuenilv m-*de in othtn comexcs about Rradualc riluciMun in general 
A lyior? ilireci implic^tton of i*ich variance!^ in response would l)c the 
*'tarR«4rtg'* of areas, activirie^, or funciions Khai the professional staff slioufd 
study more closely. This is readily accomptished by examining the specific 
Items that make up a particular scale; It ji;iould be possible to identify the 
"specifics of the case" and U should be po.vsible for the professional staff to 
improve the particular *cUvity* or function ablstit which survey resfJondcnts 
have expressed some degree of reservaiion. 

ANAJLYStS OF SCALES AND ITEMS 

The data reported by ETS permit Intensive analysis of the 16 scales 
and the particular items that cf .nprise each scale. For the purposes of this 
report, scales and items are analysed as they relate ic the criticisms of the 
review committee, In most instances, l! wil! suffice to show the mean ratings 
by respondent group for specific items constituting a scale. Where the fre- 
quency of responses to a specific item can he irrformativ'e^ further analysis 
of the item responves will be presented. Throughout the report » however, the 
major emphasis should be placed on suivey findings that have impHcatioos 
for the continued improvement of the doctoral program in higher education. 

Administrative and Fiscal Control 

If the placement of a doctoral program in a service institute 
was "*the basic problem** to the review committee, the location of the 
doctoral program is not a problem of any consequence to responding 
faculty, students, and alumni. The scales for learfiipg environment, 
scholarly excellence, quaJity of teaching, and faculty concern for stu- 
dents may be examined in detail - with no impUcation that the doc* 
toral program in higher education is physkaiiy or academically mis- 
placed. 

A break out of the items on (he learning envtronmeni scale 
firmly endorses a climate or atmosphe/e for teaming in which differ 
ences in viewpoint are encouraged, students and professors enjoy each 
other's respect, and students work cooperatively in meeting academic 
demands. Lesser ratings are recorded for '*team or joint effort" with- 
in the Institute and by the alumni for 'Veceptivity to new Ideas/* 
Ratings for the former are related, no doubt, to the *'loosc style** of 
administration within the institute and the rating by alumni Is ex- 
plained, in part, by the manner in which the doctoral program was 
originally structured. Several changes )n the orjjani/ation of the pto^ 
gram have already t;een effected, but the lack of team effon is not 
seen as necessitating a new style of administration or managemcni. 

Mean ratings for the items dealinn with scholarly excellervc? or 
productivity are consistently curnputed as 3.0 or higher. There is 
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TABLL 2 



BREAKDOWN OF Lt ARNING iNVtRONMLNT SCALl 



hem 



Encouragement of different 
icholarly views 

Mutual respect between . 
students and K>rofc5sors 

Team or joint effort wJthln 
department 

Laclk of exploitation of 
students by professors 

Mutual support and help among 
students In mecting academic 
demands 

Receptivity to new ideas 
and ways of d ing things 



Mean Ratings by . 
, Faculty ' Student 



331 



3.62 



2.77 



3.62 



3.46 



3 52 
3.S7 
2.95 
3.15 
3.81 

3,10 



Alumni 



3.51 



3.63 



2.69 



333 



3.77 



2.88 



ERIC 
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SCHOLARLY EXCtLLENCE AND FACULTY CONCERN FOR STUDENTS 



Mean Ratings by: 



Item 



Taculty 



Student 



Alumni 



Scholarly Excellence Scale: 

Inieilectuai environment 

»» 

Students' scholarship and ^ 
research ability 

Faculty's scholarship and 
research ability 

"This doctoral program Is 
one of the best in the field," 



3.23 
3.00 

3.23 

3.23 



3.29 
3.20 

3.62 

3i53 



3.23 
3.05 

3.33 

3.37 



Facu^y Concern for Students Scale: 

Faculty Interest In students' 
welfare and professional 
development 

Many opportunities exist for 
faculty-student interaction 
outsidcclass 

Accessibility of faculty to 
students 

Good faculty-student communi 
cation regarding students' 
needs, concerns, suggestions 

Overall faculty*student relations 



3.62 



3.08 



3.69 



3.46 



3.67 



2.70 



3.35 



3.29 



3 29 



3.69 



195 



3.53 



3.30 



3.30 
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TABLE 4 



BREAKDOWN OF QUALITY OF TEACHING SCALE 



Item 



Mean Ratings by : 



Students 



Alumni 



Faculty Preparation for Courses 
' Evaluation Procedures 
Constructive Criilciwn 
Overall Quality 
Teaching Methods 
Faculty Helpfulness 
Faculty Awareness of New Ideas 



4» 

3.14 
3.38 
3.26 
3.14 
3.05 
3.43 
3.71 



3,15 
3.30 
3.28 
3,07 
2.84 
3.28 
3.43 
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appreciable consensus in Table 3 Vimx the doctoral prb^^am Is "one of 
the best" and that the Institute \% "an intcllectuAiiy stirnlrfating place 
for doctoral students to study/' 

The variance of opinion concerning faculty concern for students, 
which was mentioned previously, can be seen in Table 3 as attributable 
to a lack of opportunity for 'MnteractMTii outside the classroom." 
Fit°ulty Interest in students, their accessibility to students, communi* 
cation between the two groups, and overall facuity/st^^ent relations 
are consistently rated at 3.2 or higher. 

On the sevj^n Items comprising jth? quality of teaching scale, the 
single mean rating below 3.05 In Table 4 has been tomputcd for the 
alumni. This finding is attributable in part, to the fact that many of 
the earlier graduates vt(^re taught by faculty members no longer at the 
University of Georgia\~ a fact that was pointed out by two of the 
graduates who phoned to explain the "low rating" they were compelled 
to ghre. 

The gist of these findings must be fhat faculty, students, and 
alumni are in significant agreement about the leai'ning environment 
provided by the Institute, its scholarly climate, the quality of teaching, 
and the faculty's concern for students. Students and alumni perceive 
the institute as an "environment" conducive to doctoral study and 
they express appreciation of the Intellectual and/or academic stimu- 
lation they have received. 

Program Objectives and Resources / 

The appropriateness of program objectives, the ease of intra- 
campus communications, and the use of other campus resources can be 
addressed by exs^mining the responses of faculty, students, and grad- 
uates to specific items on the curriculum, depairtmental procedures, and 
available resources scales. As showp In Table 5, the mean ratings of 
faculty, students, and graduates suggest substantial agreement about the 
depth and variety of course offerings, opportunities that students have 
to pursue Individual projects, and the flexibility of program require- 
ments in meeting student needs. Students and alumni rate the inter' 
action of their doctoral program and related disciplines beiow the 3.0 
they have given other curricular matters, but it is not obvious how the 
term "related disciplines'' may have been interpreted, it is reasonably 
certain that students and alumni interpreted "related disciplines" as 
the twenty«hours-outs{de«educatlon they take. 

More directly related to the appropriateness' of program objec- 
tives are items on the departmental procedures scale pertaining to 
"agreement between degree requirements and stated objectives," the 
relevance of degree requirements to anticipated work in the field, and 
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TABLE 5 



CURRICULUM AND PROGRAM PROCEDURES 



Item 



Mean Ratings by: 



Facuisy 



Student 



Alumni 



Curriculum Scale: 

interaction between department 
and other related disciplines 

Depth in subject matter In 
course offerings 

Opportunities for students to 
pursue indh/iijiual projects 

Variety of course and program 
offerings 

Flexibility of prograrhs):o meet 
student needs 




Depirtmcntai Procedures Scale: 

Department helps graduates find 
appropriate employment 

Agreement between degree require- 
ments and stated objectKes of 
department 

Refevance of courses in related 
fields to meet degree require- 
menis 

Adminlstrztion of degree 
requirements 

ReievarKre of degree require- 
ments to anticipated work 



r 



Quality of advising 



3.15;,^,. 

331 

3.77 

3.31 

3.54 



3.85 
3,43 

3.23 

3.54 
3.54 



2.85 

3.19 
3.45 
3.10 
3.33 



3.21 
3.42 

3.21 

3.47 
3.32 
3.05 



2.95 
3.19 



3.42 
3.33 
3.40 



3.00 
3.60 

3,47 

3.47 
3.36 
3.21 
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ihe ff ievaiKC of courses in related flefdj to degree requircmcni*^. On 
thcK t^ree iterni no m,caii rating by the three groups falls below 3.2 
and graduates of the profjram, as discussed previously in connectinr> 
witii their personal characteristics, give the compatibility of program 
objectives and requirements a firm 3.6 rating. This interpretation is 
borne out by the finding that only one faculty member, one student, 
and one graduate rated the agreement of degree re()utrements and 
stated objectives ai "fair." None of the 88 respondents rated the agree- 
ment as **poor." 

in terms of the resources available to doctoral students, all 
three groups of respondents are in agreement about the quality of 
library holdings (M»3.2 or higher). Only the faculty were asjted 2hou( 
the adequacy of physical and financial resources^ hov^ever, and at 
least one faculty member has Indicated that these are '*poot" Two 
faculty miembers have rated these resources "fair" while the remaining 
ten re^ondents regard resources as "good" or '^excellent." With 
respect to facilities and equipment, graduates of the program have 
assigned lower ratings (M»2.8} than faculty (M^SJ) or *»Mdent3 
(M»3.0). Although sJight, this variance of opinipn couid eaf.ny be i 
function of when the alumni were engaged in their doctoral studies. 

\ candid interpretation of scales and Items related to program 
requirements and stated objectives should underscore their compati- 
bility to each other and their relevance to anticipated work in the 
field! Faculty, students, and alumnfare in significant agreement about 
the depth and variety of coUrsework and opportunities that facilitate 
student learning. Only In the matter of physical facilities and finan- 
cial resources is there a hint of limitations. The professional staff ^f 
the institute would be most willing to conclude that their physical 
facilities should be improved and their financial resources irtcreased. 

Student Commitment and Satisfaction 

The doctoral program's "general" mission appears to be well- 
addressed in scales dealing with student commitment and satisfaction, 
faculty |>erformarKe and expectations, and the experiences of students 
in completing their doctoral dissertations and seeking professional 
employment. Assessment findings on these scales and their particular 
items imply strongly that the doctoral program is an effective program 
of preparation for profe»lonal employment; that It serves well the 
expec.tations and preferences of students entering and completing the 
program; and that the program is meeting well an obvious societal and 
professional need. 

Faculty and students are in agreement that student commitment 
to the program is substanf ial. As shown in Table 6, the faculty arc not 
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TABLE 6 



BREAKDOWN OF STUDENT COMMiTMENT/IVtOTIVATJON SCALES 



Item 



Mean Rating;iby: 



Faculty 



Students 



Students do a lot of unassigned reading in 
the field 

Students handle course assignments with 
care and responsibility 

Students demonstrate enthusiastic invdlve- 
ment with field In Informal discussions 

Students generally complete projects 
successfully despite one or more 
setbacks 



2.7S 



3.58 



3.25 



3.25 



3.05 
3.57 
3.43 
3.52 
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certain that students do a great deal of unassigned reading but they 
agree that students handle course assignments >veit; that they are 
enthusiastically involved in their studies; and that they persevere the 
completion of coursework. Students, on the other hand, agree in 
Table 7 that they have learned a great deal in the program; that the 
program provided good preparation for professional work; that thev 
would not transfer without good cause; and that they .would advise 
friends to enter the program. 

^Faculty perceive In Table 8 no banrters to student learnins in 
evaluation procedureSi teaching methods^ and the overall quality of 
instruction within the program. They assign the highest single rating 
in the entire survey (3,92} to the freedom they have in teaching and 
research {sec Appendix A for furtner evidence of the faculty's research 
and scholarship). 

In Table 9, graduates of the program rate their learning expert* 
enccs in conducting a dissertation in ntuch the same manner. The 
dissertation is apparently more relevant to the development of pro*> 
fessionai skills and employment demands than it was to the course* 
work they took but they are evidently pleased with the freedom they 
had in selecting a topic for study, their opportunities or arrangements 
to consult with faculty, and the opportunity or freedom they had for 
individual expression. 

They arc somewhat less ple»^«ed with procedures for selecting 
. commfttee members and a major professor - jn expre^^ion that makes 
sense in view of the limited number of faculty who could serve as major 
professors or members of advisory and examining committees. Only 
slightly higher is the rating assigned their satisfaction with the super^ 
vision received in carrying out tfie requirements of their dissertations. 

In fudging the value of their doctoral studies for purposes of 
employment, graduates of the progr^^m give a remarkably informative 
evaluation of the program. Mean ratings are 3.1 or higher for alt scale:^ 
with the exception of *'tccnnical skills** (M«2.9) and the '^cultural 
or social life of the university'* {M»2.4). The value of coUrsework in 
higher education and the value of coursework ''outside education'* 
receive exactly the same mean rating (3.2) while the value of ''asso- 
ciation with major professor'' and the value of "experience of working 
on the dissertation** receive a mean rating of 3.3 each. Only two 
graduates express reservations about their experience as graduate 
assistants, and only one graduate regards the knowledge gained in 
coursework or research as of *'very little value/' 

In brief, the assessment results provide commendable evidence 
that whatever student needs and expectations might be, the doctoral 
program serves those needs and expecutions well. Survey findings 



TABLt 7 

BREAKDOWN OF STUDENT SATISFACTION WITH PROGKAAt SCALE 



{lem 



Mean Ratings by; 
Students Alumni 



"I liave iearned-a great deal as a doctoral 
situdcni In the department" 

9 

Dep rtment provides very good prep- 
an tlon for professional work 

"I would advise a friend with similar 
interest to study In this department" 

If I had a chance to go t» another school 
without losing linuch in transfer, I would 

go 

4 • Disagree strongly 
3 - Disagree with reservations 
2 • A)<re« with reservatiom 
1 ' Agree strongly 
Omit 

Mean 



.SO 



3.47 



3.70 



60% 

25% 

10% 

5% 

0% 

3.40 



3.67 



3.42 



3.67 



i TABUS 

BREAKDOWN OF FACULTY WORK ENVIRONM£NT SCALt 



Mean Ratings by: 



Item Faculty 



Faculty utisfaction with academic freedom relative 3.92 
to teaching and research 

Faculty satisfaction wUh influence on departmental 3^50 ^ 
poUcie^and decbions 

Compattbliity of faculty view of graduate education 33& 
and department's emphasis 

Personal reiatlonships among department faculty 3 .23 

If H had a reasoruble offer, I would move to 
another university 

4 . Disagree strongly 62% 

3 - Disagree with reservations 1 5% 

2 - Agree with reservations 1 5% 

1 • Agree strongly 0% 

Omit 8% 

Mean 3. SO 
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TABLL 9 

BREAKDOWN OF ALUMNI DISSERTATION tXPLRIENCLS SCALt 
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Mean Ratings by 

Item Aiumnt 



Iniegratton of disserutlon research and coursewock 2M 

Freedom to select topk 3.47 

Formal and informaJ arrangements for consultation 3 JO 

with faculty 

Procedures for selecting committee membersUnd 2.98 
maior professor 

I 

Expected scope of research problem 3J9 

Satisfaction with supervisory relationship with 3J6 
committee members and ma}or professor 

Opportunity for creative thinking and indivtduai 3,26 
expression 

Relevance of dissertation experierKe to employment 3«21 
demands 

Quality of writing expected in final document 3.33 
• * 

Relevance of dWrtation experience to other 333 
professional skills 



lABLt 10 

BREAKDOWN OF VALUt OF tOUCATIONAL tXPtRlLNCl FOR LMPLOYMtN; SLALL 



Mean RdUogi bv 

llcm Alumnt 



Viiue of required departmcnui courses 3.24 

Value of coursewofk in oihcf department* / 3.24 

Value of association with other professors \ 3 J 2 

Value of elective departmeniat courses 3.28 

Value of assocUtion with major professor 3 J7 

Value of association wjifi) fellow doctorai students 3«28 

Value of dissertition experiences 3.37 

Value of knowledge gair)cd in course or rese^ch work 333 

Departoient*s sundards of scholarly excellence 3 J 2 

Value of technical skills learned 2 9$ 

Value of experience dis a research asiblant 3 JS 
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imply iirongly ihat program ubiecttves ^ntl fatuJiy expcctalionv *fc 
ckjHy communkaicd lo students, that the graduates and studcnii 
experJefKe no diiadvaniage whatsoever from the placement of the 
program in a service agency of the univ<fSftv;and that program require 
mewts and content arc obviou&ty compatible with suicd ob|ec lives 
and expectations. 

PROGRAM IMPROVEMtNT 

The implications of self-assessme|[it for program improvement arc 
many and direct- Those aspects of the progranl with whkh students and 
alumni are partkularly pleased should be strengthened, and activities or 
functions for whkh any reservation has been expressed should be examined 
closely Although only four students exp^esset' some reservation about the 
value o^f^elr gradoafe assistantshipi, the professtonal staff should make a 
concerted effort to make graduate^ulstiniships more professionally meaning- 
ful to siudems under thefr supervision^ And although students and alumni 
have gixen the faculty "high marks" in the quality of their teaching; the 
quality of classroom Instruction is a matter about whkh all faculty members 
•^lould be concerned, 

The sum i>f self-4«essmcnt findings and conclusions may be that the 
fabric of the doctoral program In higgler education is sound and whole - 
but wrinkles and creases do exist. None of these may be peculiar to the 
Uoctarat program \n higher education, and all may be more typkal of other 
^aduate programs if^ other fklds. But each wrinkle or crease should receive 
attention because the resources and capabilities of the Imtiiute are conducive 
to continued improvement of tfie doctoral program. The sdf -assessment has 
taken place at a time when other organisational changes suggest opportunities 
for improvement. For example, having its own graduate coordinator would 
peimit the doctoral program to Iron out several wrinkles in procedures for 
ad mitting and advhing graduate students. 

Perhaps the most significant findings o( the self-assessment pertain to i 
previously recognUed need to stre;>gthen the role and responsibilities of the 
maior professor Steps have already been uken to strengthen the major 
professor's role by. (1) improving the advke and consultation students 
receive on their approved programs of study, (2) placing student internships 
directly under the supervision of the major professor, (3) ettHtr identtfkatiun 
of the student's research interests and capabilities. {4} belter use of EH I 765 
for intiependenl study /research proiects. and (5) closer dkection and guklance 
in all phases of planning, organiiing, implcmentmg, and writing tho doctoiai 
diuertation. 

Other results of self-assessment must be interpreted as a strong "vote 
of confidence'* in the flexibility of program obifvtives and requirements - 
and their auommodation of diverse learning rvcfds and intercMs. There are 
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requirements in two courses that should be tightened; one course thai should 
be phased out; and a revision of title in another course. But nothing in 
the self**, cessment findings demand* substantial revisions in degree require- 
mcnts as such. If the self-asses»ntent results are road accurately, they fully 
endorse the requirement of twemy4iourvoutside'«ducatlon, an internship of 
at least one quarter's length, and the "elbow room" given students In their 
choice of disserution topics. In particular, the responses of alumni imply that 
minor adjustments in some course requirements, more consistent teaching 
styles, and perhaps closer contact with some members of the faculty would 
remove the slight dissatisfactions they have expressed. There Is other evidence 
to suggest that better assistance in the choice of a dissertation topic and closer 
uiperviilon and direction in writing the dissertation wouM accomplish most of 
the preferred changes graduates of the program would like to see. 

In conclusion, this report should emphasize the extensWe agreement 
that has been found among faculty, students, and alumni. The quality of any 
dociaral pro-am is elusive, and participants In t*>e self -assessment may or 
may nof accurately perceive the quality of the doctoral program in higher 
education. The responses of 88 participants suggest, nonetheless, a 'tonsen- 
sual validation** of the doctoral program in higher education and testify « we 
trust » to its quality. 
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APPtNDIX A 

BREAKDOWN OF FACULTY RESEARCH ACTIVITIES SCALtS 



Responses by 
ttem Faculty 



Vci Nu Mean 



Keceived award or other recognition 46% 54% 1.54 

for outstanding research or , 
Khoiarly writing 

Journat-referee for professional 69% 3)% 1.31 

articles in the field in last 
two years 

Reteived outside funding for 23% 77% 1,77 

research, etc. in last three • 
• years 

Editor of professional journal • 77% 2i% 1.23 

or member of editorial board 

Have institutional or department 38% 62% 1.62 

grant for research this year 

Have funding from outside for * 23% 77% 1 .77 

research 

Served ofl^ government or f nun- S0% 43% 1.46 

dation review committees or 
national advisory councils in 
last three years 

•Receivird an iwiwd or other recogni- ' 57% 43% 1 .^l 

tion UiP outslaoding professional 
practice ^ 



Held an office or \erved on a 93% 1% 1.07 

committee of state or regionai 
professional organization 

Kecetved an award or other recog- 57% 43% 1 .43 

nition for outstanding teaching 

Held an r>ff ICC or served on the 71% 29% 1.39 

board % national profcssionj^j 
orginifatiun 



